DEVICE AND METHOD FOR COLLECTING TRAFFIC INFORMATION 



BACKGROUND OF THE INVENTION 



5 1 . Field of the Invention 

The present invention relates generally to a traffic 
information collecting device, a traffic information 
collecting method, and a traffic information collecting program 
product in a communication network, and more particularly, to 

10 a traffic information collecting device, a traffic information 
collecting method, and a traffic information collecting program 
product for collecting information required for making a load 
sharing in the communication network. 

The present invention relates to a node in the 

15 communication network, having a function to collect information 
required for making the load sharing in the communication 
network. 



2 . Descri ption of the Related Art 

20 The Internet is a connectionless network in which a 

connection is not established, and communication data are 
divided into IP packets on which an IP ( Internet Protocol ) 
address is labeled for transmission. The IP packets are 
transferred between routers based on the IP addresses, to 

25 deliver to a destination router or computer (hereinafter 
referred to simply as "an destination"). 

It is determined according to a routing protocol which 




route between the routers is used for relay based on the IP 
address to deliver the IP packets to the destination. As the 
routing protocol, at present, the RIP (Routing Information 
Protocol) or the OSPF (Open Shortest Path First) protocol is 

5 generally used. In these routing protocols, basically, a 
shortest route (or a shortest path) up to the destination is 
acquired based on cost of each link in the communication network 
(for example, a hop count), and the shortest route is set as 
a communication route of the IP packets. 

10 In these routing protocols, however, the shortest route 

is only acquired based on cost , and a route is not acquired taking 
into consideration conditions of a traffic of each link. 
Moreover, only when a topology of the communication network 
changes, the new route is set, and setting or modification is 

15 not conducted in real time. On the other hand, with the spread 
of the Internet, a packet amount (in other words, a traffic 
amount or load) intercommunicating in the internet is abruptly 
increased. 

As the result, congestion generates in the route 
20 determined by the routing protocol. 

To be sure, but in the OSPF protocol there is a routing 
called an equal cost multipath that a plurality of the routes 
are determined in order to disperse the IP packets to the 
plurality of routes. However, this routing can be used only 
25 in the case where the plurality of routes having equal costs 
are present, and also as the OSPF protocol is used, it is 
impossible to cope with real-time fluctuations of the load of 



2 



the communication network . 

Then, at present, as a technology system for avoiding the 
congestion in the internet, traffic engineering is discussed. 
This traffic engineering generally sets a plurality of routes 

5 up to the destination, and also monitors conditions of the 
traffic of each route in real time, and selects an idle route 
or a route having a small load to transmit the IP packets, and 
disperses the load (traffic) between the plurality of routes. 
In order to conduct such the traffic engineering, it is 

10 necessary that each router is informed of information in the 
traffic containing busy condition of each route. 

SUMMARY OF THE INVENTION 

15 With the foregoing in view, it is an object of the present 

invention to allow a node in a communication network to collect 
traffic information to thereby achieve load sharing depending 
on the conditions of the traffic. 

In order to achieve the above object, according to a first 

20 aspect of the present invention there is provided in a 
communication network having a plurality of nodes, which 
transmit, receive or transfer communicated information, and a 
plurality of links (communication links), which connect the 
plurality of nodes to each other, a traffic information 

25 collecting device, which is provided in at least one of the 
plurality of nodes, for collecting traffic information all or 
some of the plurality of links, comprising: a traffic 
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information collecting unit for collecting first traffic 
information of a first link connected to an own node among the 
plurality of links; a traffic information transmitting unit for 
transmitting, to the other nodes, said first traffic 

5 information collected by said traffic information collecting 
unit, using a message prescribed in a communication protocol 
in the communication network; a traffic information receiving 
unit for receiving second traffic information of second links 
connected to the other nodes among the plurality of links, said 

10 second traffic information being transmitted from the other 
nodes; and a traffic information storage for storing said first 
and second traffic information. 

According to a second aspect of the present invention 
there is provided in a communication network having a plurality 

15 of nodes, which transmit, receive or transfer communicated 
information, and a plurality of links, which connect the 
plurality of nodes to each other, a traffic information 
collecting device, which is provided in at least one of the 
plurality of nodes, for collecting traffic information all or 

20 some of the plurality of links, comprising: a traffic 

information collecting unit for collecting first traffic 
information of a first link connected to an own node among the 
plurality of links; and a traffic information storage for 
storing said first traffic information collected by the traffic 

25 information collecting unit, and second traffic information of 
second links connected to the other nodes among the plurality 
of links, said second traffic information being transmitted 
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from the other nodes. 

According to the information collecting device in the 
present invention, the node in the communication network 
collects the first traffic information of the first link 

5 connected to the own node. And also the node receives the second 
traffic information of the second links connected to the other 
nodes, said second traffic information being transmitted from 
the other nodes. The node stores the first and second 
information. In consequence, the node can be informed of the 

10 conditions of the traffic of each link in the communication 
network based on the stored information. As the result, it 
becomes possible to control the load sharing in correspondence 
to the conditions of the traffic. 

Preferably, the traffic information collecting device 

15 further comprises a traffic information transferring unit for 
transferring said second information to the other first links 
excluding the received first link. 

Thus, it is possible to propagate the second traffic 
information transmitted to a certain node, to nodes other than 

20 the certain node as well, and the other nodes receiving the 
second traffic information also can obtain the traffic 
information. As the result, all nodes in the communication 
network can grasp the conditions of the traffic of each link 
in the communication network. 

25 

BRIEF DESCRIPTION OF THE DRAWING 
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Fig. 1 is a block diagram showing a schematic 
configuration of a communication network according to an 
embodiment of the present invention; 

Fig. 2 is a block diagram showing a configuration of an 
5 input-side router; 

Fig. 3 shows a data configuration of an opaque LSA in the 
OSPF protocol; 

Fig. 4 shows a data configuration of a link data. 
Figs. 5 and 6 show exemplary of data in a system status 
2 10 that OS of the router lis collects /controls in real time; 
§1 Fig. 7 is a flowchart showing a flow of a process of the 

§3 first flooding method; 

in Fig. 8 is a flowchart showing a flow of a process of the 

H second flooding method; 

fu 15 Figs. 9 and 10 are flowcharts showing a flow of a process 

p of a third flooding method; 

Fig. 11 is a flowchart showing a flow of a detailed process 
of an update process of the opaque LSA database; and 

Fig. 12 shows a data configuration of an opaque LSA 
20 database. 



DESCRIPTION OF THE PREFERRED EMBODIMENTS 



CONFIGURATION OF COMMUNICATION NETWORK 1 
25 Fig. 1 is a block diagram showing a schematic 

configuration of a communication network 1 having a node 
including "an information collecting device" according to the 
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present invention. The communication network 1 forms a part 
of the Internet in this embodiment, and also is a communication 
network which performs a load sharing by traffic engineering 
(hereinafter called " TE " ) . Furthermore, the communication 

5 network 1 is, in this embodiment, a communication network that 
transmits and receives IP packets (hereinafter merely called 
"packets") in the asynchronous transfer mode (hereinafter 
called "ATM" ) . 

The communication network 1 is connected to 

10 transmission-side communication networks A, B, C for 

transmitting the packets to the communication network 1; and 
reception-side communication networks D, E for receiving the 
packets transmitted from the communication network 1, as 
external communication networks. 

15 These external communication networks are assorted into 

"the transmission-side communication network" and "the 
reception-side communication network," for conveniences of 
explanation of the TE. Accordingly, the transmission-side 
communication network does not mean a network which only has 

20 a transmission function of the packets, and further the 

reception-side communication network does not mean a network 
which only has a reception function of the packets . For example, 
there is a case where the packets are transmitted from the 
communication network 1 to the transmission-side communication 

25 networks A, B, C, and also there is a case where the packets 
are transmitted from the reception-side communication networks 
D, E to the communication network 1, 
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These transmission- side communication networks A, B, C 
and reception-side communication networks D, E form a part of 
the Internet, and in this embodiment, they are constructed by 
Ethernet. 

5 The communication network 1 includes a plurality of 

routers (a label switch router, to be mentioned later) as one 
example of "a node. " These routers contain an input-side router 
lis, an output-side router 11D and a plurality of transferring 
routers 11R. 

10 When the input-side router 11S receives the packets from 

the transmission-side communication network A, B, or C (or a 
computer terminal (not shown) connected to the input- side 
router IIS), the TE is executed with respect to the packets, 
and the packets are transmitted to the neighboring transferring 

15 router 11R in a route (path) set based on the TE. The 

transferring routers 11R are stationed between the input-side 
router lis and the output-side router 11D, and transfer the 
packets to the output-side router 11D relaying the packets from 
the input-side router lis. The output-side router 11D 

20 transmits the packets transmitted from the input-side router 
11S via the transferring routers 11R, to the reception-side 
communication network D or E (or the computer terminal (not 
shown) connected to the output-side router 11D). 

Hereupon also, the routers are assorted into the 

25 input-side router lis, the output-side router 11D and the 
transferring routers 11R for conveniences of explanation of the 
TE, and for example, there is a case where the input-side router 
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lis is an output-side router, or there is a case where the 
output-side router 11D is an input-side router. Furthermore, 
hereinafter, when these input-side router 11S, output-side 
router 11D and transferring routers 11R are not distinguished 
5 from each other, they are named generically "a router 11" 
merely. 

A link is provided between the routers 11 as "a 
communication link" (or "a transmission link") in which 
respective routers are physically connected to each other. For 

10 example, three links LI to L3 are connected between the 

input-side router lis and one of neighboring three transferring 
routers 11R, respectively. 

In this manner, the input-side router lis is a starting 
point for executing the TE to packets transmitted from the 

15 external transmission-side communication networks A, B, C (and 
a computer terminal connected to the input-side router 11S), 
and the output-side router 11D is an ending point of the TE. 
Accordingly, a section from the input-side router lis to the 
output-side router 11D is sometimes called "a TE section." 

20 According to this embodiment, the communication network 

1 is configured so as to set a route by using MPLS (Multi-Protocol 
Label Switching) as one example of a label switch technology. 
For this reason, the input-side router lis, output-side router 
11D and transferring routers 11R are configured as a label 

25 switch router (hereinafter referred to as "LSR" ) . 

The MPLS is a technology for fusing a routing processing 
of an internet protocol of the layer 3 in the OSI reference model 



9 



and a switching processing of the layer 2 such as ATM, frame 
relay, or the like. The LSR uses "a label" which is information 
of a lower level layer than an IP address, as packet transfer 
(packet switching) information. When an ATM switch is used for 
5 a packet transfer engine (label switch engine) of the LSR, 
VPI/VCI (Virtual Path Identifier /Virtual Connection 
Identifier) is used as the label. In other words, the IP 
addresses are mapped onto the labels (VPIs/VCIs) and a packet 
transfer is carried out by use of the labels. 
10 The MPLS transfers the packets on the preset route 

(virtual connection) which is called the LSP (Label Switched 
Path) . This LSP may be set along the route defined by a present 
routing protocol like the OSPF protocol, and may be set 
independently of a route by the present routing protocol. 
15 Furthermore, a plurality of the LSPs can be set up to an 
destination (router or computer terminal). 

Accordingly, the plurality of LSPs are set independently 
of the present routing protocol, and a load (traffic) is 
dispersed between these LSPs, thereby enabling the TE. 
20 Furthermore, in the MPLS the plurality of LSPs needs not 

to be preset necessarily. It is possible that a router always 
monitors a traffic amount in the communication network 1, and 
when the traffic amount of a certain route is increased, the 
router searches another route directing to the same destination, 
25 sets a new LSP on the route, and shares the traffic to the new 
LSP. Thereby as well, it is possible to perform the dynamic 
TE in correspondence to a state of the traffic of the 
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communication network. 

A plurality of the LSPs can be set within one link. For 
example, within one link having a bandwidth of 100 [Mbps (M 
bit/sec)], the five LSPs with 20 [Mbps] can be set, 
5 respectively. 

The setting of the LSP can be performed by reserving the 
bandwidth of the link in the route using, for example, RSVP 
(Resource Reservation Protocol) or RSVP-tunnel obtained by 
extending RSVP . 

10 In the communication network 1, as the route (the label 

switching path, the virtual connection in the ATM) by this LSP, 
as shown in Fig. 1, three routes 21 to 23 have been in advance 
set, or dynamically generated. In other words, the input-side 
router lis has the three routes 21 to 23 for transmitting the 

15 packets. 

The respective three routes 21 to 23 are configured by 
the LSP(s) provided in one or two links or more. Furthermore, 
all the links configuring the respective routes 21 to 23 are 
not always different links, and any or all of the links are 
20 occasionally configured by the different LSPs provided in the 
same link. 

The input-side router lis is positioned on the boundary 
of the transmission-side communication networks A, B, C outside 
of the TE section. The router lis adds a label to a packet 
25 transmitted from the transmission-side communication network 
A, B or C, and transmits it to the transferring router 11R. 

The transferring router URs carry out label-switching 
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for the labeled packets, and transfer the labeled packets to 
the output-side router 11D. Accordingly, the transferring 
router URs can transfer (label-switching transfer) the packets 
by only label information without retrieving the routing entry 
5 of the IP addresses of the packets. 

The output-side router 11D is positioned on the boundary 
of the reception-side communication networks D, E outside of 
the TE section. The output-side router 11D removes the label 
of the packets from the transferring router 11R, and transmits 
10 these packets to the reception-side communication network D or 
E (or the computer terminal of the output-side router 11D). 

As the communication network 1 employs the ATM as 
mentioned above, the label refers to here the VPI/VCI, and also 
the packets are transferred as ATM cells. 
15 m order to make the load sharing of the traffic by setting 

the route of the LSP(s) in correspondence to a state of the 
traffic of the communication network 1 , each router 11 exchanges 
information in the traffic of each link and of each LSP in each 
link connected to itself. Hereinafter " information in the 
20 traffic" is merely referred to as "traffic information". In 
exchanging this traffic information, according to this 
embodiment, an opaque LSA (Link State Advertisement) that is 
a peculiar LSA in OSPF (Open Shortest Path First) protocol is 
used. 

25 in the opaque LSA, there is in particular not any provision 

in information that the opaque LSA can include therein, 
excluding a LSA header and LSR interface information to be 
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mentioned below. In this way, the opaque LSA has a freely using 
region. Furthermore, in the opaque LSA, there is not either 
any provision what time propagated, excluding a point that 
flooding is used as its propagation (transmission) technique. 

5 In this way each router can propagate the opaque LSA(s) at the 
desirable time. Moreover, as the opaque LSA follows the OSPF, 
the opaque LSA can be used in the communication networks such 
as the internet, etc. Accordingly, the opaque LSA which has 
the freely using region containing the traffic information is 

10 propagated, whereby the traffic information can be exchanged 
between the routers in the present communication network such 
as the Internet, etc. 

CONFIGURATION OF THE ROUTER 11 
15 Fig. 2 is a block diagram showing a configuration of the 

input-side router US by representing the router 11. The 
input-side router US includes a processing unit 30; a memory 
device 32; and interface devices 41 to 46. Furthermore, when 
the computer terminal is connected to the input-side router US, 
20 a computer terminal interface device 47 is provided. 

Incidentally, as the transferring router 11R and output-side 
router 11D have the same configuration as the input-side router 
11S, excluding a case where the number of interface device(s) 
is (are) different and a case where the connection 
25 destination(s) is (are) different, only the configuration of 
the input-side router US will be explained hereupon. 

The memory device 32 can be configured by a hard disk 
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device, etc., and contains a link state database 32a and an 
opaque LSA database 32b. The link state database 32a is a 
database defined by the OSPF protocol and stores link states. 
The opaque LSA database 32b is a database storing the opaque 
5 LSAs, and the detailed description will be mentioned later. 

The processing unit 30 has a CPU, a memory (RAM, ROM, etc. ) , 
and the like (not shown) . This processing unit 3 0 controls the 
memory device 32 and the interface devices 41 to 46 (47) in 
accordance with a program stored in the internal memory or the 
10 memory device 32. And also the processing unit 30 carries out 
setting of routes, control of the load sharing in correspondence 
to a state of the traffic, transmission and reception of the 
packets (ATM cells) , generation, transmission and reception of 
the opaque LSAs, update of the link state database by the 
15 received opaque LSAs, update of the opaque LSA database by the 
received opaque LSA, or the like according to the program. 

The interface devices 4 1 to 4 6 (47) contains anl/O buffer , 
and process I/O of the packet (ATM cell) for transferring 
respective connected links under the control of the processor 
20 30. 

A hardware switch configured by a hardware circuit is 
provided in the router US, and can transmit and receive the 
packets (ATM cells) (containing generation of the ATM cells and 
switching of the labels (VPIs/VCIs ) ) . 

25 

Data configuration of the opaque LSA 

The traffic information is flooded between the routers 
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11 by use of the opaque LSA(s) in the OSPF protocol, as mentioned 
above. This opaque LSA has a data configuration shown in Fig. 
3. In Fig. 3, a digit designated in an uppermost part is a bit 
number. Accordingly , Fig. 3 shows that the opaque LSA stands 
5 in a row in 32 bits (4 bytes) unit. 

There is not any provision of the opaque LSA, excluding 
the fields of the LSA header and LSR interface information, and 
the opaque LSA has a freely using field (a field of link 
information of Fig. 3). Accordingly, according to this 
10 embodiment, the traffic information is flooded between the 
routers 11 by use of the opaque LSAs having the data 
configuration shown in Fig. 3. 

The opaque LSA is assorted largely into the LSA header 
and an opaque field. 
15 The LSA header has 20 bytes, and has the same data 

configuration as the normal LSA (i.e., the LSA other than the 
opaque LSA) . In other words, the LSA header is constructed by 
respective fields such as a link state age, an option, a link 
state type, an opaque type, an opaque identifier (an opaque ID) , 
20 an advertising router, a link state sequence number (LS sequence 
number), a link state checksum (LS checksum), and a length. 

"The link state age" has 2 bytes, and designates a lifetime 
(second unit) of this opaque LSA, namely a valid period. 

11 The option" has 1 byte, and is a field where it is set 
25 so that the router supports an optional function, or the support 
level can be transmitted to the other routers. A second bit 
of this "option" field is called O bit, and designates whether 

15 



or not the router supports the opaque LSA (is opaque-capable) . 

"The link state type" has 1 byte, and designates a type 
of LSA. In the opaque LSA, a value of the link state type is 
9 , 10 or 11, and a flooding scope differs corresponding to this 
5 value. 

When this value is 9, the flooding scope of the opaque 
LSA is "link-local," and within a local ( subnetwork. In the 
case of 10, the flooding scope is "area-local," and the opaque 
LSA is not flooded beyond the area that it is originated into. 

10 In the case of 11, the flooding scope is "equivalent to 

AS-external LSA, " and the opaque LSA is flooded throughout the 
AS (Autonomous System). In particular, (1) the opaque LSA is 
flooded in all transit area; (2) the opaque LSA is not flooded 
from backbones to stub areas; and (3) the opaque LSA is not 

15 generated from a certain router into stub areas connected to 
the router. 

"The advertising router" has 4 bytes, and is a field 
storing an IP address of the router that creates and advertises 
the opaque LSA. The link state number and link state checksum 
20 are used in the case where 2 or more opaque LSAs created by the 
same advertising router are present, when it is determined which 
one is up-to-date (latest temporally). "The length" is has 2 
bytes, and designates a length (a byte number) of the opaque 
LSA. 

25 "The opaque field" includes LSR interface information and 

one or more sets of link information. The number of the sets 
of the link information is equal to the number of links connected 
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to the router 11. 

The LSR interface information has 4 bytes, and is 
configured by an upper 2-byte E_B field and a lower 2-byte link 
count field. "The E_B field" designates whether the router is 
5 an area border router or an AS boundary router . "The link count" 
designates the number of links connected to the router. 

"The link information" is configured by respective fields 
such as a link identifier, a net mask, a connection type, a LSP 
count, and a link data. 
10 "The link identifier" has 4 bytes, and designates the IP 

address of the neighboring router or computer terminal 
connected to the link. "The net mask" has 4 bytes, and 
designates a (sub-)net mask of the link identifier. "The 
connection type" has 1 byte, and designates whether a 
15 destination of the link is a router, a computer terminal, or 
the like. The LSP count has 1 byte, and designates the number 
of LSP provided in the link. This value dynamically changes 
as the number of LSP during communication changes. 

"The link data" is configured by a plurality of data. Fig. 
20 4 shows a data configuration of the link data. The link data 
have link statistical information of the link and LSP 
statistical information of each LSP formed in the link. These 
link statistical information and LSP statistical information 
are one example of "information in the traffic (traffic 
25 information)" pertaining to the present invention. 

"The link statistical information" has an link average 
usage rate field (Ave_Utilization) , an output link discarded 
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packet number field (Loss), and an output link bandwidth field 
( Bwl ) . 

"The link average usage rate" has 4 bytes, and designates 
an average usage rate of the link. This link average usage rate 
5 Ave_Utilization is calculated by the following equation (1): 

Ave_Utilization = a x CUTY(n) + (1-a) x CUTY(n-l) ... (1) 
This equation (1) is a calculation equation by a moving 

average. Here, a is a smoothing coefficient. CUTY(n) 

designates a present (namely, time n) link usage rate, and 
10 CUTY(n-l ) designates a link usage rate of one time past (namely , 

time (n-1)), respectively, and they are obtained by the 

following equation ( 2 ) : 

CUTY(n)= Cthe number of packets outputted to the output 

link from time (n-1) to time n} / (Bandwidth of the output link} 
15 ... (2) 

The average usage rate may be set as a maximum of the 
observed CUTY, and in this case, the average usage rate is 
represented by the following equation (3): 

Ave_Utilization = max (observed value) ... (3) 
20 "The output link discarded packet number" has 4 bytes, 

and designates the total number of the discarded output packet 
of the link. The total number is calculated by the following 
equation ( 4 ) : 

Loss(n) = Loss(n-l) + NLoss ... (4) 
25 Here, Loss (n-1) is the total number of the output link 

discarded packets up to time (n-1) of one time past, and NLoss 
is the number of output link discarded packets generated from 



18 



time (n-1) to time n. 

"The output link bandwidth" has 4 bytes, and designates 

bandwidth [bps (bit/sec)] of an output link. This output link 

bandwidth has been in advance stored in a memory of the 
5 processing unit 30 or the memory device 32 of each router 11 , 

and the stored value is written in the field of the opaque LSA. 
"The LSP statistical information" has a LSP identifier 

field (Lsp_id), a LSP_COS class field (Cos_lsp), a LSP average 

usage rate field ( Ave_UtilityJLsp) , a LSP output discarded 
10 packet number field (Loss_lsp), and a LSP bandwidth field 

(Bwl_lsp) . 

"The LSP identifier" has 2 bytes, and designates an 
identifier of the LSP. "The LSP_COS class" has 2 bytes, and 
designates the COS class of the LSP. 
15 "The LSP average usage rate" has 4 bytes, and designates 

an average usage rate of the LSP, and is obtained by the equation 
that the output link is replaced by not a link, but LSP in the 
equations (1) and (2) . Furthermore, similarly to the equation 
(3), it can be set to a maximum of the observed value in the 
20 LSP. 

"The LSP output discarded packet number" has 4 bytes, and 
designates the total number of the discarded output packet of 
the LSP, and is obtained by replacing the output link by the 
LSP in the equation (4). 
25 "The LSP bandwidth" designates bandwidth [bps] allocated 

when the LSP is set. This LSP bandwidht is stored in the memory 
of the processing unit 3 0 or the memory device 3 2 of the router 
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11 that has output links in which the LSPs are set, at the time 
of setting the LSP. The LSP bandwidth value in the memory is 
written in the field of the opaque LSA. 

The above-mentioned link average usage rate, output link 
5 discarded packet number, LSP average usage rate, and LSP output 
discarded packet number are obtained on the basis of data (file) 
representing a system status (CPU load, the number of 
transferring packets, etc.)- These data are, for example, 
collected and managed in real time by an operating system (OS: 
10 for example, Linux) of each router 11. 

Figs. 5 and 6 show examples of data in a system status 
that OS of the router US collects /manages in real time. Fig. 
5 shows a content of the file in a directory "/proc/net/dev" 
of the memory device 32 provided in the router lis in the form 
15 of table. Fig. 6 shows a content of the file in a directory 
" /proc/atm/device" of the memory device 32 in the form of table. 

Figures shown in these drawings are examples of data at 
a certain time. Furthermore, these figures designate 
integrated values from when the router lis is turned on, and 
20 as OS collects in real time (fixed time interval At), they 
change every moment. As these figures are integrated values, 
for example, by acquiring a difference between a value when 
referring to this table at time (n-1 ) and a value when referring 
to this table at time n, it is possible to acquire variation 
25 between 1 time from time (n-1) to time n. 

The upper half part of the table shown in Fig. 5 designates 
data in reception of the router lis as shown by a character of 
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"Receive", and the lower half part designates data in 
transmission of the router IIS as shown by a character of 
"Transmit." Hereinafter, the upper half part of the table is 
called "a reception table," and the lower half part is called 
5 "a transmission table." 

The "interface" in the reception table and transmission 
table designates the kind of interface connected to the router 
IIS. As this interface, there are "lo, " "ethO," "ethl," "eth2," 
"atmO," "atml," and "atm2." 
10 "lo" is an abbreviation of "loopback device," and means 

an interface with the computer terminal (not shown in Fig. 1) 
connected to the router IIS. "ethO" to "eth2" mean the 
interface with the Ethernet. As the transmission-side 
communication networks (Ethernet) A to C are connected to the 
15 router US, as shown in Fig. 1, "ethO" means the interface with 
the transmission-side communication network A, and "ethl" means 
the interface with the transmission- side communication network 
B, and "eth2" means the interface with the transmission-side 
communication network C, respectively. 
20 "atmO" to "atm2" mean the interface with the ATM. As 

shown in Fig. 1, as three links Ll to L3 of the communication 
network 1 configured by the ATM network are connected to the 
input-side router US, "atmO" means the interface with the link 
Ll , "atml" means the interface with the link L2 , and "atm2" means 
25 the interface with the link L3 , respectively. 

The "bytes" of the reception table and transmission table 
designates a byte number received from each interface and a byte 
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number transmitted to each interface, respectively. For 
example, it is indicated from the data of the interface "lo" 
that the input-side router US receives data of 6084 bytes from 
the computer terminal, and transmits the data of the same byte 
5 number to the interface "lo." 

The "packets" of the reception table and transmission 
table designates a packet number received from each interface 
and a packet number transmitted to each interface, respectively. 
For example, it is indicated from the data of the interface 
10 "ethO" that the router US receives 324 packets from the 

transmission side communication network A and transmits 267 

packets thereto. 

The "errs" of the reception table and transmission table 
designates an error number of the reception packet from each 
15 interface and an error number of the transmission packet to each 
interface , respectively . 

The "drop" of the reception table and transmission table 
designates a discard number of the reception packet from each 
interface and a discard number of the transmission packet to 
20 each interface, respectively. 

The "fifo" of the reception table and transmission table 
designates a packet number (length of queue (FIFO)) of a 
reception process waiting and a packet number (length of queue 
(FIFO)) of a transmission process waiting, respectively. 
25 The "frame" of the reception table designates a reception 

frame number, and the "compressed" designates a compressed 
packet number, and the "multicast" designates a reception 
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multicast packet number, respectively. 

The "colls" of the transmission table designates a 
generation number of collision in the Ethernet (CSMA/CD system) , 
and the "carrier" designates a carrier detection number in the 
5 Ethernet, and the "compressed" designates a compressed packet 
number , respectively . 

The "interface type" of the table shown in Fig. 6 
designates three types of ATM interface of the links Ll to L3 
of the communication network 1 , and "0 eni" is No. 1 of interface 
10 name "eni," and "1 eni" is No. 2 of interface name "eni," and 
"2 eni" is No. 3 of interface name "eni." 

The "ESI/"MAC addr"" designates a MAC (Media Access 
Control) address. The "AAL (Tx, err, Rx, err, drop)" designates 
statistical information in the packet of an ATM adaptation layer. 

15 The "Tx" designates a transmission packet number, and a left 
side "err" designates a transmission error number, and the "Rx" 
designates a reception packet number, and a right side "err" 
designates a reception error number, and the "drop" designates 
a reception discard packet number, respectively. 

20 Both Figs. 5 and 6 show data in the link, and the OS can 

collect data in each LSP provided in the link. 

As this system state is collected in real time (each fixed 
time interval At) by the OS, data of each field of the 
above-mentioned link data are acquired based on these collected 

25 information. 

For example, by acquiring a difference between "packets" 
of the transmission table of Fig. 5 at time (n-1) and "packets" 
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of the transmission table at time n, an output packet number 
of the equation (2 ) is acquired. Furthermore, the output packet 
number which is the difference is divided by the bandwidth of 
the link, whereby CUTY(n) of the equation (2) is acquired. 

5 Furthermore, Ave_Utilization of the equation (1) is acquired 
based on this CUTY(n). 

Furthermore, as the transmission table of Fig. 5 or the 
"drop" of Fig. 6 is an integrated value of the discard packet 
number, a value of the "drop" at time n is Loss (n) of the equation 

10 (4). 

FLOODING METHOD OF THE OPAQUE LSA 
(1) First flooding method 

The opaque LSA is transmitted to other routers by use of 
15 the flooding. A timing of the flooding can be set, for example, 
in each fixed time interval Tth. This fixed time interval Tth 
is equal to or more than the time interval At when the system 
status is updated (preferably, the time interval Tth is equal 
to a positive integer times At) , and is set to an interval that 
20 the communication network 1 is not congested by transmission 
of the opaque LSAs, and also an interval that the TE can 
effectively be conducted. The specific value is acquired by 
experiments, simulations, computations, etc. 

Fig. 7 is a flowchart showing a flow of a process of a 
25 first flooding method. This process is executed by the 
processing unit 30 (refer to Fig. 2). 

First, when the router 11 is activated by turning on the 
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router 11, etc., a timer (not shown) provided inside the 
processing unit 30 starts timing (step S10). 

Subsequently, it is determined whether or not time t of 
the timer reaches the flooding time interval Tth (step S12). 
5 When not reaching it (NO in step S12) , it is determined whether 
or not the LSAs are received from the other routers 11 (step 
S26). When the LSAs are not received from the other routers 
(NO in step S26) , returning to step S12, and when received (YES 
in step S26) , it is determined whether or not the received LSA 
10 is an opaque LSA (step S28) . This determination is made by the 
value of the link state type of the above-described LSA header. 
When the link state type is 9 , 10 or 11 , it is determined that 
it is the opaque LSA, and when other than those, it is determined 
that it is a normal LSA (LSA other than the opaque LSA). 
15 in the case of the opaque LSA (YES in step S28 ) , the opaque 

LSA database is updated (to be mentioned below) (step S30) , and 
after that, the received opaque LSA is transmitted (flooded) 
to all the links (output links) other than the received link 
(step S32). After that, the process will return to step S12. 
20 On the other hand, in the case of the normal LSA (NO in step 
S28), a reception process of the normal LSA is performed (step 
S3 4 ) , and after that, the process is returned to step S12 . This 
reception process of the normal LSA contains an update process 
of the link state database. 
25 When time t of the timer is time Tth or more in step S12 

(YES in step S12), it is determined whether or not the LSA is 
received from the other routers (step S14). 
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When the LSA is received (YES in step S14) , the processes 
of steps S16 to S20, S36 are performed. These processes are 
similar to those in steps S28 to S32, S34, as above, respectively. 
Then, as the timer time t elapses in a fixed time interval Tth, 
5 the processing unit 30 creates the opaque LSA of its own router, 
and the opaque LSA is transmitted (flooding) to all the links 
(output links) (step S22). 

Subsequently, the update process of the opaque LSA 
database by the opaque LSA of the own router is performed (step 
10 S23). And, the timer is reset to 0. Then the process will 
return to step S12. 

On the other hand, in step SI 4, when the opaque LSA is 
not received from the other routers, the opaque LSA of the own 
router is generated immediately, and is transmitted to all the 
15 links (step S22). Then, the update process of the opaque LSA 
database by the opaque LSA of the own router is performed (step 
S23) . And, the timer is reset (step S24) , and the process will 
return to step S12. 

20 (2) Second flooding method 

Among the flooding methods, there is a method in which 
when the opaque LSA is received from the other routers, the 
received opaque LSA is transmitted, and also the opaque LSA 
which accommodates traffic information of the own router is 

25 generated to transmit. This method is called "a second flooding 
method" . 

Fig. 8 is a flowchart showing a flow of a process of the 



26 



second flooding method. The same symbol is labeled to the same 
process as that in the above-mentioned flowchart of Fig. 7, and 
the detailed description is omitted. The processing unit 30 
executes this process. 
5 First , when the router 11 is turned on, etc. and starts, 

the timer starts (step S10), and it is determined whether or 
not the time t of the timer reaches threshold time Tthl (step 
S50) . This threshold time Tthl is set to a time interval which 
is time interval At or more when the OS of the router 11 updates 
10 the system status, and which is smaller than the time interval 
Tth in the first flooding method. The reason why the time Tthl 
is set as above is that even when two or more opaque LSAs are 
received from the other routers before this fixed time Tthl 
elapses, the opaque LSAs of the same content in the own router 
15 are not flooded twice or more. 

When the time t of the timer reaches the threshold time 
Tthl (YES of step S50), the processing unit 30 waits for 
receiving the opaque LSA from the other routers 11 (step S14) . 
After receiving the opaque LSA, the processing unit 30 creates 
20 the opaque LSA which accommodates the traffic information of 
its own router and transmits it (steps S14 to S24, S36). 
Subsequently the process is returned to step S50. 

On the other hand, when the time t of the timer does not 
reach the threshold time Tthl (NO of step S50) , even if the own 
25 router 11 receives the opaque LSA from the other routers 11, 
the own router 11 does not create the opaque LSA which 
accommodates the traffic information of itself and transmit it 
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(steps S26 to S34) . Subsequently the process is returned to step 
S50. 

(3) Third flooding method 
5 There is a third flooding method in which the first 

flooding method and the second flooding method are composited* 
In other words, the opaque LSAs are transmitted at the fixed 
time interval Tth (a first flooding method), and also when the 
own router receives the opaque LSA from the other routers 11, 
10 it transmits the received opaque LSA, and also creates the 
opaque LSA which accommodates the traffic information of itself 
to transmit (a second flooding method). 

Figs. 9 and 10 are flowcharts showing a flow of a process 
of the third flooding method. The same symbol is labeled to 
15 the same process as that in the above-mentioned flowchart of 
Figs. 7 and 8, and the detailed description is omitted. The 
processing unit 30 executes this process. 

After the timer starts (step S10), it is determined 
whether or not the time t of the timer elapses in the fixed time 
20 Tthl as mentioned in the second flooding method (step S50). 

When the time t of the timer does not reach the fixed time 
Tthl (NO of step S50), the processes in steps S26 to S34 are 
executed. In other words, when the own router receives the 
opaque LSA from the other routers 11, the own router executes 
25 the database update process by the opaque LSA, and also 

transmits this opaque LSA to the other router. Subsequently, 
the process is returned to step S50. 
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On the other hand f when the time t of the timer reaches 
the fixed time interval Tthl (YES of step S50), the timer time 
t is compared with the fixed time interval Tth mentioned in the 
first flooding method (step S12). 

5 When the time t of the timer does not reach the fixed time 

interval Tth (NO of step S12 ) , the own router waits for reception 
of the opaque LSA from the other routers 11, and executes the 
LSA received from the other routers 11 (database update process, 
transmission process to the other router, or the like) (steps 

10 S16 to S24, S36) . Subsequently, the process is returned to step 
S50. 

On the other hand, when the time t of the timer reaches 
the fixed time interval Tth (YES of step S12), the own router 
creates the opaque LSA which stores the traffic status of the 

15 own router irrespective of presence or absence of reception of 
the opaque LSA from the other routers and transmits it (steps 
S52 to S64). Incidentally, the processes of steps S52 to S60 
are similar to the processes of steps S26 to S34, respectively, 
and the processes of steps S62 to S64 are similar to the processes 

20 of steps S22 to S24, respectively. Subsequently, the process 
is returned to step S5(K 

Data configuration of the opaque LSA database and its 
update process 

25 Fig- 12 shows a data configuration of an opaque LSA 

database 32b provided in the memory device 32 of the router 11. 
The opaque LSA database 32b has a hash table 50, opaque 
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LSA database structures (hereinafter referred to as "an OLDB 
structure") 51a to 51c, 52a to 52d, 53a, 53b, etc having the 
opaque LSA of each router (containing the own router) 11. 

The hash table 50 has a plurality of memory cells. Each 
5 memory cell is accessed with a hash value hi, h2 , h3, or the 
like as its address* The hash value is determined by hashing 
the value of "an advertising router" (namely, the IP address 
of the advertising router) in the LSA header of the received 
opaque* A pointer to the OLDB structure is stored in each memory 
10 cell. For example, the pointer to the OLDB structure 51a is 
stored in the memory cell in correspondence to the hash value 
hi. The pointer to the OLDB structure 52a is stored in the 
memory cell in correspondence to the hash value h2, and the 
pointer to the OLDB structure 53a is stored in the memory cell 
15 in correspondence to the hash value h3, respectively. The 
pointers to the other OLDB structures (not shown) are also 
stored in the memory cells in correspondence to the other hash 
values (not shown). 

The OLDB structure contains a content (each field shown 
20 in Figs. 3 and 4) of the received opaque LSA. It also contains 
the pointer to the neighboring next OLDB structure (for example, 
the OLDB structure 51a contains the pointer to the next OLDB 
structure 51b), a field required for calculating a distance 
(cost) up to a root, etc. One router 11 corresponds to one OLDB 
25 structure. 

As the hash value of the hash table 50, for example, it 
is possible to use a quotient (integer value) obtained by 
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dividing an "advertising router" value (IP address) of the LSA 
header deemed as an integer by a prime 251. In this case, the 
hash table 50 has 251 memory cells, and the plurality of routers 
11 in the connection network 1 are classified into 251 groups, 
5 The pointers connect the OLDB structures of the plurality of 
routers belonging to each group classified into the 251 groups, 
for example, like the OLDB structures 51a to 51c. 

Incidentally, as the IP addresses of the routers 
belonging to the same group are close, the routers are placed 
10 at geographically close positions in many cases . 

In this manner, as the routers can be classified into the 
groups by using the hash table, as described below, when 
retrieving the OLDB structure of a specified router, it is 
possible to accelerate the retrieval. 
15 Fig. 11 is a flowchart showing a flow of a detailed process 

of an update process of the opaque LSA database in steps S18, 
S23, S30 and S64 shown in Figs. 7 to 10. The processing unit 
30 of each router 11 executes this process. 

First, the processing unit 30 determines whether or not 
20 it is possible to ensure a storage region of the OLDB structure 
for storing the opaque LSA within the memory device 32 (step 
S100). When it is possible to ensured (YES in step S100), the 
processing unit 30 ensures the storage region (step S102) , and 
stores the received opaque LSA in the ensured storage region 
25 (step S104) . 

Subsequently, a hash value of the IP address of the router 
that transmitted the opaque LSA is calculated, and the memory 
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cell having this hash value as address in the hash table 50 is 
determined (step S106). Subsequently, it is determined 
(namely, retrieved) whether or not there is an OLDB structure 
which agrees with the IP address of the router that transmitted 
5 the received opaque LSA from among one or more OLDB structures 
connected to the determined memory cell by the pointers (step 
SI 08) . In this retrieval, since a retrieval scope is pinpointed 
to the group of the OLDB structures corresponding to one memory 
cell of the hash table 50, it is possible to retrieve at a 

10 high-speed. 

When there is no coincident OLDB structure (NO in step 
S118) , the OLDB structure which stored the received opaque LSA 
is connected to the endmost of the OLDB structure(s) connected 
to the memory cell determined in step S106. For example, when 

15 the hash value is hi of Fig. 12, the OLDB structure of the 
received opaque LSA is connected to the rear of the OLDB 
structure 51c, and the pointer to the connected new OLDB 
structure is stored in the pointer region provided in the OLDB 
structure 5 lc . 

20 On the other hand, in step S108, when there is any 

coincident OLDB structure (YES in step S108), it is determined 
whether or not the received opaque LSA is up-to-date (latest 
temporally) (in other words, the opaque LSA having the 
up-to-date traffic information) (step S110). 

25 When the received opaque LSA is not up-to-date (NO in step 

S110), it is discarded and the memory region ensured in step 
S102 is released (step S112). On the other hand, when the 
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received opaque LSA is up-to-date (YES in step S110), this 
up-to-date OLDB structure is exchanged for an old OLDB structure 
which has already existed in the database 32b (step SI 14) . For 
example, when the OLDB structure 51b of Fig. 12 is exchanged 

5 by the OLDB structure (referred to as "an OLDB structure x" ) 
having the received new opaque LSA, the OLDB structure x is 
inserted into this same position. Alternatively, the OLDB 
structure 51c is connected to a very rear of the OLDB structure 
51a, and also the OLDB structure x can be connected to a very 

10 rear of the OLDB structure 51c. 

Subsequently, the memory region of the OLDB structure of 
the old opaque LSA is released (step S116), and the process is 
ended . 

15 ONE EXAMPLE OF THE LOAD SHARING 

Finally, one example of a load sharing which is carried 
out on the basis of the traffic information of each router 11 
stored in the opaque LSA database 32b will be explained as 
follow. 

20 Respective logical bandwidths (bandwidths of LSP) [bps] 

of routes 1, 2, 3 (refer to Fig. 1) are set to 10M, 8M, 2M, 
respectively . 

In order to control the load sharing by means of the TE, 
the input-side router IIS (processing unit 30) first calculates 
25 each effective load of the routes 1,2,3. Here, "the effective 
load" is an effective usage rate that is calculated based on 
a usage rate of the link and a packet discard rate (packet loss 
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rate) in this link. Although the actual load of the link had 
better be measured, this effective load is used, because it is 
difficult to measure the actual load directly in the case where 
the router 11 has a multistage switch configuration. 
5 When the effective load of route i is set as 

p_ef f ective_path_i, this effective load can be acquired by the 
following equations (8) and (9), for example: 

p_ef fective_path_i = p_path_i x f (Loss_path_i) ... (8) 
p_ef fective_path_i = Min(p_ef f ective_path_i, p_ceiling) 

10 ... (9) 

Here, p„path_i is an average usage rate of the entire one 
or more links (link_j) which configures the route i (path_i), 
and is acquired by the following equation (10): 

p__path_i = Average ( Ave_Utilizat ion ( link_j , path__i)) ... 

15 (10) 

Furthermore, Loss_path_i is the total of a discard packet 
number (Loss_link_j ) of each link which configures the route 
i, and is acquired by the following equation (11): 
Loss_path_i = 2Loss_link_j ... (11) 
20 The function f is a function for correcting so as to 

calculate higher a load in the case where the discard of packet 
is carried out. This is because, when no packet is discarded, 
the link load p_path_i agrees with the effective load, and when 
the discard of packet is carried out, it is necessary to correct 
25 higher the load. p_ceiling is an upper limit value of the 
effective load. 

Now, when the effective loads of the routes 1,2,3 are 
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set to p_ef fective_path_l = 0.5, p_ef f ective_path_2 = 0.2 and 
p__ef fective_path_3 = 0.3, respectively, effective traffic 
amounts [bps] of the routes 1,2,3 are 10M x 0.5 = 5M, 8M x 
0.2 = 1.6M and 2M x 0.3 = 0.6M, respectively. 
5 Subsequently, the router lis (processing unit 30) 

performs load adjusting. First, all the routes 1, 2, 3 are 
deemed as a virtual single pipe, and the average usage rate 
pave__ef fective of this pipe is acquired by the following 
equation: 

10 pave_ef fective = 2(p_ef f ective_path_i x LBW_path_i) 

-r 2LBW_path_i ... (12) 

Here, LBW_path_i is a logical bandwidth of the route i. 
When the equation (12) applies the above-mentioned 
example , 

15 pave_ef fective = ( 5M+1 . 6M+0 . 6M) / ( 10M+8M+2M) =0 . 36 

Next, effective bandwidth AEBW_path_i [bps] which 
shifts between the routes is calculated by the following 
equation: 

AEBW_path_i = (pave_ef fective - p_ef f ective_path_i) 

20 x LBW_path_i ... (13) 

When this is calculated in each of the routes 1, 2, 3, 
the following answer is obtained: 

The effective bandwidth AEBW_path_l, shifting in the 
route 1 = (0.36-0.5) x 10M = -1.4M 
25 The effective bandwidth AEBW_path_2 , shifting in the 

route 2 = (0.36-0.2) x 8M = +1.28M 

The effective bandwidth AEBW_jpath_3 , shifting in the 
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route 3 = (0-36-0.3) x 2M = +0.12M 

The total of the effective bandwidths shifting in the 
routes is -1 .4M+1 * 28M+0 . 12M = 0 

When the load adjusting is performed based on this 
calculation result, in the route 1, 5M-1.4M = 3.6M, and in the 
route 2, 1.6M+1.28M = 2.88M, and in the route 3, 0.6M+0.12M = 
0.72M, and in the routes 1, 2, 3, the load sharing (distribution 
of the traffic) is changed at a ratio of 3.6xGr : 2.88xGr : 
0.7 2xGr. The symbol Gr denotes a load adjusting coefficient. 

According to the present invention, the nodes in the 
communication network can collect the information in the 
traffic in the communication network, and control the load 
sharing by the information. 
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